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Abstract 

Scaled type Markov renewal processes generalize classical renewal pro- 
cesses: renewal times come from a one parameter family of probability 
laws and the sequence of the parameters is the trajectory of an ergodic 
Markov chain. Our primary interest here is the asymptotic distribution of 
the Markovian parameter at time t — > oo. The limit, of course, depends 
on the stationary distribution of the Markov chain. The results, however, 
are essentially different depending on whether the expectations of the re- 
newals are finite or infinite. If the expectations are uniformly bounded, 
then we can provide the limit in general (beyond the class of scaled type 
processes), where the expectations of the probability laws in question ap- 
pear, too. If the means are infinite, then - by assuming that the renewal 
times are rescaled versions of a regularly varying probability law with ex- 
ponent < a < 1 - it is the exponent ct which emerges in the limits. 

1 Introduction 

Heavy tailed probability distributions have recently arisen in new interesting 
applications, it is sufficient to mention waiting times in queueing networks like 
the internet or stock prices. For us the laws with exponents a — and ^ came 
into play in stochastic models of physical phenomena as return times to the ori- 
gin of processes which are proved to behave analogously to random walks on 
Z rf where d = 1 or 2 (more concretely, in stochastic paradigms of two Lorentz 
disks in the plane or in a quasi-one-dimensional slab, see a forthcoming article 
of the authors). 
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Markov renewal models are themselves interesting mathematical objects 
and, in particular, the model of scaled type renewal processes, suggested by the 
physical model, seems to be a fortunate notion. As to some history: Markov 
renewal processes (or Semi Markov processes) were independently introduced 
in 1954 by Levy [12], Smith [18[ and Takacs [19|. The basic theory was de- 
veloped by Pyke [14|, [15| and then further elaborated among others by Pyke 
and Schaufele [16[, Cinlar [3|, [4[, Koroliuk and his coauthors. For a recent 
treatment see |2J or the works of Jannsen |9|,|10|. Nevertheless, none of these 
authors seem to have addressed the situation when the waiting times have 
infinite means. Indeed, it is not at all clear how to formulate results in gen- 
eral. However, scaled type processes generated by a slowly varying law as 
suggested by our physical model (cf . Section 6) provide a suitable model for 
treating these questions. 

In this paper we give a comprehensive answer for the most original primary 
question related to Markov Renewal processes: we determine the asymptotic 
distribution of the Markovian parameter at time f — > oo. Our main interest 
is the case when the variables have infinite expectations and the process is of 
scaled type. To emphasize coherence, we also prove - by using our method - 
results, already known for the finite mean case. We develop an operator for- 
malism and use some facts from perturbation theory to develop a key lemma 
from which most of our results follow easily. 

In the theory of ordinary renewal processes, the first attempts to extend the 
well known result of Feller and Smith ([8], [17]) to the infinite mean case were 
performed by Erickson([7J), Teugels ([20]) and Anderson&Athreya ([1]). As for 
the Markov renewal process, some partial results has been already obtained, 
e.g. in [13], many properties of the spent time (age-) process (see Sect 5.) were 
established under different assumptions for the alternating renewal process. 
In this paper we show that under certain assumptions, the classical result of 
Dynkin (0) still holds. 

The paper is organized as follows. Section 2 contains our definitions and 
our key technical result. Sections 3, 4, 5 deal with its consequences while sec- 
tion 6 presents the physics application which drove our attention to the topic. 
Finally section 7 is devoted to the proofs of our theorems. 

Note 1. We originally used the name Renewal Process directed by a Markov Chain 
(RPdMC), but we decided to stick to traditions and to use Markov renewal process. 
Some authors use the name Semi-Markov process for the whole phenomena, but we 
only refer to a particular process by this name. 

2 Definitions and basic results 
2.1 Basic definitions and conditions 

Consider a measurable function (t) = F(A, t) : [a, b] x M+ — > [0, 1] with 
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Basic assumptions: 

For fixed A, F\(.) is a non-arithmetic distribution function (1) 

35 > : sup F A (S) < 1 (2) 

A6 [a,b] 

3K e M+ : inf F A (X) > (3) 

Ae[a,fa] 

We will need random variables X\ with distribution function F\ . If X A has 
expectation, then is denoted by px ■ 

Remark 1. Conditions $2$ and <(3j implies that there is no sequence (A z -)j>o that X\. 
would converge either to the point mass at zero or to infty in distribution (or - as the 
limit is non-random - in probability). 

Definition 1. The family of distributions defined above is called scaled-type if there 
is a distribution function F : R+ — > [0, l]/or which 

F A (f) = F(At) 

In this case, the basic assumptions are satisfied if0<fl<b<oo and 
moreover if p = xdF(x) is finite , then p\ = pi A. 

Also suppose we have a recurrent Harris chain (cf. e.g. Chapter 5.6 in |5| ) 
(Ao, Ai,...) on [a,b] with transition kernel g(\-,A). Suppose that this chain 
has a spectral gap, which means that the spectrum of its transition operator on 
Loo ( [a, b] ) is bounded away from the unit circle except for the eigenvalue 1 and 
finitely many other eigenvalues on the unit circle. Let p s denote the stationary 
measure. 

Definition 2. Suppose (Ao, \\, X-i, . . . ) G [a, b] K . Then the sequence S n = TljZo ^Ay : 
n = 1,2, . . . with So = is called a Non-Homogeneous Renewal Process (NHRP) 
if Xx , X Al , Xx 2 , ... is an independent sequence of random variables such that V/ 6 N 
the distribution of X\. is F\.. If furthermore F\{t) = F(M) with some distribution 
function F, then we call the process a Scaled-type Renewal Process (STRP). 

Definition3. The sequence S n = YTjZq ^Aj '■ n — 1,2,... with the convention 
So = is called a Markov renewal process if 

• Aq, Ax, A2, ... is a homogeneous Markov chain introduced above and 

• for every realization Aq, Aj, . . . of this Markov chain S„ : n = 0, 1, 2, . . . is a 
non-homogeneous renewal process. 

(Notation: if we want to emphasize the dependence of the process on Aq, we write 

Sji,Aq'/ 
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Consider a Markov renewal process and - by complying with the classical 
renewal terminology - let Nf a„ denote the number of renewals that occurred 
before time t (including the one at t = 0) with initial parameter value Ag, i.e. 

N Uo = inf{n : S„ M > t} (4) 

and let U\ g (t) = ENf /Aq . Denote the "type" of the renewal ongoing at time t 
by A(t) = An -i and the distribution of the parameter A(f), conditioned on 
the initial parameter value A , by ®t,\ > ie - 

O f , Ao (A) = P(A(f) e A e B([a, b])\A = A ) (5) 

Note 2. A(f) is a so called Semi-Markov process since it would be a continuous time 
Markov chain on [a, b], if for every A, F\ were an exponential distribution function. 

By conditioning on the first renewal, the renewal equation writes as 

d» f/Ao (A)=l {AoeA} (l-F Ao (0)+ (6) 
[\ t _ sM {A)g{X ,dX 1 )dF Xo {s) 

J a 

All the basic phenomena are governed by equations like lHJ. Since this is 
not the usual renewal equation, we have to generalize standard renewal theory. 
Our first result is an existence and uniqueness theorem. 

Theorem 1. For any measurable function h r x (A) which is bounded on bounded 
intervals, i.e. 

(Vf >0)(3M t <oo): \h S/Ao (A)\ < M t Vs E [0,t] 
the solution of equation 

YUo(A) = h Uo (A) + f [\ t _ sM (A)g(\ ,dM)dF Ao (s) (7) 

JO J a 

exists and is unique among the functions that vanish for t < and are bounded on 
bounded intervals. 

Moreover, the solution can be given as an infinite series: 

Y Uo (A)=h Uo (A)+ (8) 

n=1 J[a,b] n JO \ J i=Q 

where II* denotes the convolution product. 

This form of the solution is troublesome to work with, but we can also write 

YfcAo(>4)= / , r h^ S/A (A)U Ao (d S/ d\) (9) 

J [0,t] x [a,b] 



4 



where we introduced the functions 

U Ao (t,A) = l {AoeA} @(t)+g(A ,A)F Ao (t)+ (10) 

oo . n— 2 

+ E / u g(K~i,A)(n*)?- 1 F Ai (t)Ug(\ i/ dA i+1 ) 

Here &{t) = 1 if t > and zero otherwise. This can be further written 

CO 

U Ao (t, A) =t A (A )+Y^ Pa (X Ao + ... + X An _ 1 < t;A n £ A) (11) 
n=l 

so U Aq (t,A) is the expected number of jumps into the set A before time f (plus 
1 if the process is launched from A). The integration in 10 is wrt the measure 
defined by 

U Aq (A x [fi,f 2 ]) = U Ao (f 2/ A) - U Ao (h,A) 

for A G £([«,*>]) andO < t x < t 2 < °°. 

Note that from (HD it is clear that !i A() (f ) = !I Aq (f, [a, b] ) . 

2.2 Laplace transforms 

Introduce the Laplace transform of F: 



a> A (z) =/ e~ zx dF A (x)=z e~ zx F A (x)dx z>0 
Jo JO 

From the last formula, it is easy to see that I0 and © imply for z > 

sup cp A {z) < 1 inf <p A (z) > (12) 

Ae[a,6] A6 [ fl ' fc l 

In the scaled type case, f A {z) = <p(z/A), where <p(z) is the Laplace transform 
of the measure dF{.) Also let 

cv Ao (z,A)= [ e- zs U Ao (ds,d\) = r e- zs U Ao (ds,A) (13) 
J[0,oo]xA JO 

For fixed z, a; Ao (z, .) is, of course, a measure on [a, &]. By the virtue of (TTTb 
this can be also written as 



a, Ao (z, A) = l A (Ao) + E E (e" z(XAo+ - +XA - l) l{A»6A} Ao = A ) 
Also let S Aq (z, A) be the Laplace transform of Yf jAfl (A) in the variable t, i.e. 
S Ao (z,A) = jf e- zt Y tM (A)dt 
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Then by 10, Fubini's theorem, and the product rule of the Laplace transform, 
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E Ao (z,A)=/ <p x {z,A)co Xo {z,d\) (14) 

J a 

where the integration is wrt the measure defined in (TT3b and cpx{z,A) is the 
Laplace transform of h t ^(A), i.e. 

<Pa(z,A)= / e~ zt h t>A (A)dt (15) 
Jo 

In all the applications, h is so, that this Laplace transform exists. Clearly, then 
E A() (z, A) exists as well. Despite its simplicity, it is not equation <Tl4t which 
proves useful in the sequel. Instead, take the Laplace transform of (0 to obtain 

rb 

Z Xo {z,A) = <p Xo {z,A)+ S Al (z,A)«p Ao (z)g(A ,dA 1 ) (16) 

J a 

VA e [a,b] andVA G B([a,b]). 

2.3 Key lemma 

Recall that 

Definition 4. A positive function L(t) defined on R>q zs slowly varying at infinity if 

The key element in the treatment is the following 

Lemma 1. Whenever U\ < oo for all A 6 [a,b], or the process is scaled type with a 
regularly varying ancestor distribution, i.e. 

l-F(t) = r a L(t) ae[0,l] 

where L is a slowly varying function at infinity, we have 



asz^O provided that 



su PAe[«,b]^A(z,A) 
lim sup — r ■ — - < oo 

z^O f°<p A (z,A)dp s (\) 



Remark 2. The main idea behind Lemma[[\is that the asymptotic behaviour is inde- 
pendent of the initial state. Thus the asymptotic formulas must be identical with what 
would be exact if the distribution of Xq was the stationary one. 
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2.4 The operator formalism 

In the proof of Lemma [TJ we use a perturbation approach in the framework of 
an operator formalism developed in this section. 

As usual, let L w [a, b] denote the set of bounded, measurable functions on 
[a, b] . The transition operator of the Markov chain (defined by the kernel g of 
the previous section), denoted by P, operates on this space by 

PfW = / 6 /(A'k(A,dA') / G Leo A G [a,b] 

Of course, on the adjoint space M. ( [a, b] ) (i.e. every signed measure on [a, b] of 
finite total variation) its effect is given by 

rb 

jiP(A)= g(\,A)dji(\) ji G M([a,b]),A G B{[a,b]) 

J a 

Also define the operator valued functions <p(z), $(z), and E(z) acting on 
Loo ([a, b}) by 

(0(z)/)(A) = <p A (z)/(A) tf(z)l A )(\) = <^a(z,A) 

(S(z)l A )(A) = S A (z,A) 

where / G Lco([a, b\), 1 A is the indicator function of A. In the last two defini- 
tions, the operators are defined on the linear span of step functions in Loo ( [a, b] ) . 

With these, it can be easily seen that equation (fT6b is equivalent to the oper- 
ator equation 

S(z) = <£(z) + <p(z)PS(z) 
This yields the formal solution 

&(z) = (I-4>(z)P)- 1 $(z) (18) 

Condition fl2t ensures the existence of the inverse for every z > 0, since 
\\q>{z)\ \ =sup Ae[fl/fe] <p A (z) < 1. 

Denote the effect of a measure \i in JVi { [a, b] ) as a functional on an element 
/of Loo ([a, b\) with (^,/),i.e. 

(F'f) = / f d F 

J[a,b] 

and note that e.g. 

E Ao (z,A) = (J Ao ,S(z)l A ) 

where £ Ao is the point mass concentrated on Ao. In this framework, Lemma 1 
can be rephrased as 
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Lemma 2. Suppose }i\ < oo VA £ [a, b] or that 

1 - F A (f) = 1 - F(Af) = {Xty a L(At) a £ [0, 1] 
where L is a slozvly varying function. Then if 

limsup l|( jj (2) |] <co (19) 

fen 

fx A / m, \ (p S/ #(z)1a) k n 

(V^)i,)- (ps/(f _. (z))1) *-o 

if/zere 1 = l[ fl/ 6]. 

Conjecture 1. Lemma\2\is likely to be true under the somewhat milder condition that 

jip s = J u\dp s (A) < oo, which allows ji\ to be infinite on a p s -negligible set if<p(z) 
is nice in some sense. The ground of this suggestion is that a p s -negligible set cannot 
have large effect on asymptotic relations. This question does not arise in the scaled type 
case, so we do not pursuit it in the sequel. However, we mention 

Corollary 3. If the annihilator of p s i.e. 

A Ps = {f eLoo{[a,b]):{p s ,f)=Q} 

is an invariant subspace of <p{z) for every z, then the assertion of Lemma\2\holds if 
p A — oo only on a p s -null set. 

3 Generalization of the renewal theorem (asymp- 
totics of U\ (t, A) 

In this section, we investigate the asymptotic behaviour of U\ {t,A). To do 
this, note that 10 implies that if h t ^ (A) = I^Aq), then we have Y t/Ao (A) = 
U\ Q (t,A) and also <p\{z, A) = \ A (\)/z. The assumption ((191 is satisfied if 
|0 S (A) > 0. Then Lemma Q] yields 

a; Ao (z,A)-l A (A )~- F - l — — p s (A) z^O (20) 

Ja i 1 ~ fA{z))dp s (A) 

(note the difference between oj and S!). Thus we have 

Theorem 2. For A £ B([a, b]) with p s (A) > 0, we have for p ps < oo that 

U Ao (i / A)~ — p s (A) f^oo (21) 

V-Ps 

while in the scaled type case for a £ [0, 1), 

t a sm(TZLx) / noL sin(Tra) / 'noc p s {A) 

U\At,A) ~ yj-r-T —ps(A) - 



W) f a x-*dp s {\) * ' 1 ~ F ( t ) f h a X-«dp s {X) 
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Note that if a — 0, the last factor is one. When a = 1, one obtains 



where L = f Q f (l — F(s))ds varies slowly and U Ao (f, A)(l — F(f)) — > in addition. 

Remark 3. If p s (A) = 0, then P(A„ G A) < C^e -7 ", ro/zere 7 z's z7ze spectral gap 
of the Markov chain. Thus by i fTTl l, o;e /zaz?e t/ie estimate 

li Ao (f, A) < 1 + E P ( A » e A ) < iTTTF 

iw/*zere f/ze Zasf inequality implies that only finitely many times does the chain jump to 
A as t — > 00 with probability one. 

4 Asymptotic results for <E>^ (A) 

In this special case h t ^{A) = 1{aga}(1 — F A (f))/ ® becomes 
* f ,A (A)= I (l-F A (t-s))dU Ao (s,A) 

J [0,t] xA 

and<£ A (z,A) = 1{agA}(! ~ <Pa(z))/z. Thus 

^ fl fc (l-<p A ,(z)))^ s (A') 



(22) 



Here < |T9l is satisfied of for every A, 







liminf / 1 ? a(z) zip s (A) > (23) 
>o l-mf Ae[8/i ,](p A (z) 



z- 



which holds if ps(A) > 0. To see this note that in the finite mean case l fl2l 
ensures that inf Ag t a u zz A > and ((23) flollows from the asymptotic expansion 
of the cp's. In the scaled type case note that the integral in | |23l admits the lower 
bound 

, 1- cp(az) , A . a 

due to concavity of 1 — q>. Our result is 

Theorem 3. For A £ B([a, b\) with p s {A) > 0, we have 



lim <D a (A) = — [ y x dp s (\) VA G [a,b] 

M-oo J,L ps J A 



(24) 
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if}ip s < oo. In the scaled type, finite mean case, this becomes 

=#8S VAoeMl <25) 

If in the scaled type case 1 — F(f ) = t~ K L(t), we have 

lim *f Ao A = 

'-"» '° />-«dp s (A') 

ztf/zic/x implies that in the special case a = 0, f/ze ZzVm'f is just p s (A). 

Remark 4. p4) aj-zd j25l l are true for p s (A) = as well, since ®t,Ao zs fl measure 
(Apply the result to A c ). 

5 Results for the age process and the residual and 
total lifetimes 

Let Yt,\ denote the time since the last renewal occurred and Zt r \ is the remain- 
ing time until the next renewal, i.e. 

Vo = t ~ S N,,a Z f,Ao = S N t ,A +l - 1 

The total lifetime is the sum C t)/ \ Q — Yt,\ + Zf,Ao- 

It is easy to see, that P(Yf r \ < x)lyi(Ao) satisfies 10 with the inhomoge- 
neous term hJ A (A) = l^ x ](f)l /1 (A)(l — F A (f)). Of course, in the end we will 
set A — [a, b], but now we need the dependence on A to make <p a linear oper- 
ator. This yields 

<pl(z,A)=\ A {\) J Q X e- zt (l-F A (t))dt 
Since we can use the bounded convergence theorem for fixed x, we have 

<pl(z,A) -> 1a(A) J*(l - F A (t))dt > z^O 
and therefore by Lemma Q] (since ((T9l l is automatically satisfied), 

^A ( z ' [«/ fe ] ) 7FZ 

J fl (l-(p A (z))rfp s (A) 

It is also not hard to obtain that P(Z t/Ao < x)l^(Ao) also satisfies 10 with 
hf A (A) = l^(A)(F A (f + x) — F\(t)), and after some calculation, we get 

lim*f(z,A) = lim*J(z,A) 

z— >0 z— >0 
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soSf o (z, [a,b]) ~ Sj o (z, [a,b]). 

As to C\ 0/t , one can obtain hf A (A) = l^(A)lr ^(f)(F A (x) — F\{t)), thus for 
the Laplace transform (p^{z, A) — > Jq(F^(x) — Fx{i))dt as z — >■ and 



" A ° S!(l-9x(z))dp.(X) 



Theorem 4. lf]ip s < oo then 



F(Y tM <x) \^J_ [ x [ b 

P ( Z f,A < x ) ) Hp s J0 Ja 



{l-F x {t'))dp s (X)dt' 



and 



P(C Uo < x) -> J- /"* /Va(x) - F A (0)^ s (A) 



When the expectations of the waiting times are infinite, there is no proper 
asymptotic distribution of Yt,A ' all the mass escapes to infinity. Instead, Y tXQ /t 
has a limit distribution. The following results are generalizations of the one 
due to Dynkin about ordinary renewal processes. (Cf. [8 J XIV.3). 

Theorem 5. Ifl — F(f) = t~ a L{t) with < « < 1 in the scaled type case, Y t/ ^/t 
converges in distribution to the distribution with density function 

71 

while the limit density function ofZ t/ \ Q /t is 

sin(7ra) 1 



7T x a (l + x) 

In the a = case, 

Y t,Ao V 1 Z f,A V 
t t 
In the a = 1 case we can only state 



t — > oo 



f r 

Remark 5. These formulas are identical to the original ones, which means that the 
presence of different kinds of renewal times is irrelevant asymptotically. 

6 An application 

Semi-Markov theory is one of the most efficient area of stochastic processes to 
generate applications in real-life problems. We cannot give here a complete 
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view of such applications in the fields of (paraphrasing Barbu and Limnios) 
Economics, Manpower models. Insurance, Finance, Reliability, Simulation, 
Queuing, Branching processes. Medicine (including survival data). Social Sci- 
ences, Language Modelling, Seismic Risk Analysis, Biology, Computer Science, 
Chromatography and Fluid mechanics, mainly due to the lack of expertise, (see 
e.g. M or M\)) 

Therefore, we present the application, which motivated our model the prob- 
lems treated. Namely Random Walks with Internal States in one and two di- 
mensions. Shortly we investigated continuous time random walks with inter- 
nal states in which the speed parameter was the internal state changing ac- 
cording to a Markov chain at every visit of the random walk to the origin. In 
two dimensions, it was a paradigm model to the two disk Lorentz process, i.e. 
two disks wandering in a periodic scatterer configuration and changing energy 
when they collide with each other. 

It can be shown (cf . an upcoming article of the authors) that the return times 
to the origin are regularly varying with exponent a = l/2ind = l, and slowly 
varying in d — 2, i.e 



F fl=1 (f)~Ci r/ 1-F a=z {t) 



logf 



The exact values of the constants are not important now. Suppose for ease 
that the stationary distribution is uniform. In the physical model [a, b] = 
[vE, ViE], where E is the total energy of the two colliding disks. 

Our results yield to the expected number of returns to the origin (number 
of collisions) 



A ° {1 ttC 1 E 1 / 4 (2 1 /4-1) a ° [ ) C 2 



Interesting that the energy dependence vanishes in d = 2 (and this is not be- 
cause of the special choice of p s (A) which is a good approximation). 

The answer to the question concerning is the asymptotic distribution of the 
speed is simple as well. Note, that due to our assumption of p s (A), the limit 
distribution has density 

A -1/2 i 
3> d= l (A) = <5 rf= ? (A) = 

^ocvV'V 2El/4(2l/4 _ 1) ^oo,A V l ) y/E(V2-l) 

Finally, Y\ 0r t 1 1 and Z^ 1 / 1 has the limit distribution specified in Theorem [5] 
The meaning for a = is that the current excursion asymptotically dominates 
the whole process. 
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7 Proofs 

7.1 Used facts 

For the following proofs, we need the so called Abelian-Tauberian theorems 
(see IB] XIII.5). 

Fact 1 (Feller). Let Hbe a measure on IR + , k(z) = J e~ zx dH the Laplace transform 
wrtit and H(x) = H([0,x})! Thenfor p > 0, 

kU/x) 

-+t~P x -> oo 

K(l/X) 

and 

H(tx) 
H(x) 

imply each other, moreover in this case 

k(1/x) ~H(x)T(p + l) x->oo (26) 
A popular reformulation of this result is 
Fact l.lfL is slowly varying in infinity and < p < oo, then 

k(1/x) ~ x p L(x) x — y oo 

and 

1 

H(x) ~ —, ^x p L(x) x — > oo 

imply each other. 

The following result is Example (c) XIII.5 in [8] 
Fact 3. For p < 1 

l-F(x) ~ x~PL(x) and 1 - cp(z) ~ z?L(l/z) 

imply each other. 

7.2 Proof of Existence&Uniqueness of the solution 

Proof of Theorem^ Suppose we have two such solutions and denote their dif- 
ference with Y f/Ao (A). This function satisfies the homogeneous version of 10: 

Y t/Ao (A) = f / fc Y t _ S/Al (A)^(A ,rfA 1 )dF Ao (s) 

JO J a 
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and clearly |Y f/Ao (A)| < 2M t if |Y S/Ao (A)| < M t for s < t. If we iterate n times, 
then through a little manipulation (can be checked by induction), we get 

J[a,b\ n JO \ J i=0 

where n* denotes the convolution product, so 

\% M (A)\<2M t f f'df (Il*)to F ^ s )) fU(A*,dA m ) = 

J{a,b}» JO \ J i=Q 

= 2M t f (n*)^ 1 F Ai (t)flg(Kd\ l+1 )=2M t F(S nM < t) 

J[a,b}» i=Q 

which goes to zero as n — > oo for all f by (fTTb if ii Ao (f) < oo for every finite f. 
But this follows from the fact it is clearly less than the renewal function of a 
classical renewal process with distribution function 

F(x) — sup F\(x) 

AS [a,b] 

which is not the point mass at zero by condition ©. Now the statement follows 
by the result of ordinary renewal theory 

From the proof of uniqueness, one can deduce that if we iterate in the in- 
homogeneous equation 10, then the remainder term converges to zero. Thus 
after some calculation, we get exactly the solution given in the theorem. The 
convergence of the series (|8) can be checked by noticing 

Y tM (A) < M t U Xo (t) 

where \h S/A(j (A)\ < M t for s < t. □ 

7.3 Proof of the Key Lemma 

Proof of Lemma\2\ Note that 

I - Q(z)P = I - P + (I - 4>(z))P (27) 

We will treat the second term as an asymptotic perturbation, where the param- 
eter of the perturbation is z. 

First consider the \i\ < oo case. Then for / £ Leo ( [a, b] ) 

{(I - <?>(z))/}(A) = (1 - <p A (z))/(A) = z FA /(A) + o A (z) 

where o. (z) is a vector for which | \o, (z) 1 1 /z — >■ as z — > 0. Thus 

(I - $(z))P = z]iP + o(z) 
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where }i is the operator on L<»([fl, b\) defined by (^/)(A) = }i\f(k) and the 
meaning of o(z) is straightforward. Since 1 is a simple isolated eigenvalue of 
P, which is stable under the perturbation due to the assumed spectral gap (and 
to the number of eigenvalues on the unit circle being finite), using Theorem 2.6 
in Chapter VIII in [ 11 [, we have that 

I-f(z)P= (cz + o(z))(n + o(l))+K(z) (28) 

where Tlf = (p s ,f)1, vTl = (v,V)p s , and K(z) is the operator arising from the 
rest of the spectra and projects to the annihilator A ps of p s (see Conjecture 1). 
Its essential property is that the part of the spectra it is representing is bounded 
away from zero as z — > 0. o(l) is here an operator converging to zero in norm 
asz^O. 

By (I - P)l = 0, one obtains from igZj and |28} 

{p s ,(I-<p(z))Pl) = {cz + o(z))(p s ,t) 2 + o{z) = cz + o(z) (29) 

since (p s ,K(z)l) = o(z). To see this, note that 

= (p s + zpi + o(z), K(z)(l + zli + o(z))) 

where l(z) = 1 + zlj + o(z) is the perturbed right eigenvector that corresponds 
to the unperturbed eigenvalue 1. (These asymptotics are guaranteed by the 
theorem cited above.) After rearrangement, 

(p s ,K(z)l) = -z( i (p x ,K(z)l) + (p„K(z)li)) + o(z)=o(z) (30) 

since ||X(z)l||, \\p s K(z)\\ -> 0. 
Using the formula i 



where (9(1) is a bounded operator which comes from the spectra of K(z) being 
bounded away from zero. With a little arrangement and application of | |29|| , 

where we used PI = 1 and o(l) is just a real valued function converging to 
zero as z — >■ 0. 

This yields by CD 

S(z) — (I — ^(z)P)-^(z) = n^lL^ V + o(l)) + 0(l)$(z) 
and finally by p s Tl = p s 



(* Ao ,E( Z )l A ) 



(p s ,(I-f(z))l), 

(5 A0 ,O(l)4>(z)W 



•o(l) + o(l)- 



(p s ,<P(z)l A ) 
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By the assumption of the theorem, the explicitly written factor is bounded for 
small z, so the whole expression goes to 1 as z — »■ 0. 

In the infinite mean but regularly or slowly varying scaled type case for 

«e[o,i), 

i-<p A (z) = (^f r(i-«)^) (i + o(i)) = 

= z a L(l/z)r(l - a)A" a (l + o(l)) 
where the first equation is due to Fact[3] Thus 

(I - 0(z))P = z a L(l/z)M a P + o(z a L(l/z)) 

where (M a /)(A) = T(l — a)A~ a /(A). Repeating the finite mean proof with 
z -B- z a L(l/z) gives the desired result. 

In the remaining a = 1 case, we have by the Lemma on p. 280 in |8], that 
H(t) = /J (1 - F(s))ds is a slowly varying function. Thus by Fact|2 

l-<p(z) =zH(l/z)(l + o(z)) 

so (1 - <p(z))P = zH(l/z)M x + o(zH(l/z)). Note that zH(l/z) -> as z -»■ 0, 
and again by the virtue of the finite mean proof, we are ready. □ □ 

Proof of Corollary\5\ Introduce jioo = {A £ [a,b] : ]i\ = oo}. What we will show 
is that ps(pico) = implies that jtco can be almost literally dropped from the 
state space and thus the assertion. 

If Ap s is an invariant subspace of <f>(z), then it is also an invariant subspace 
of S(z) as well and thus by lAnp*, £ A ps 

(p s ,E(z)l A ) = (p s ,E(z)l An , (go ) 

Note also that we can assume Ag i. \ioo since with probability one, ther is 
an n for which A n £ }ioa and we can consider the process launched from there. 
Then 

(A ,S(z)l A ) = (A ,S(z)l An ^) 

This implies that we only have to work in the subspace spanned by the func- 
tions in Loo ( [a, b] ) that does vanish on ji^. □ □ 

7.4 Proof of the results for U\ Q (t, A) 

Proof of Theorem^ In the finite mean case we p s -almost everywhere have 

1 - <Pa(z) = f( A z + o A (z) 

where J*f o\(z)dp s (A) = o(z). This latter can be seen by noting that q>^dp s {\) 
is the Laplace transform of the mixture of F-s with respect to jO s (A) which is a 
proper distribution function. 
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Plugging this to d20l and observing that Corollary[3]applies here, we obtain 

(, A\ 1 (X \ 1 P*( A ) l ps(A) 

v Xo (z,A) -l A (Ao) ~ ~ fc ~ --r— 

z L ndp s {X)+o{i) z }' Ps 

Using Fact[TJ the proof is ready. 

To see the the case when a £ (0, 1), note that by Fact |3] and the bounded 
convergence theorem, 

f\l - n (z))dp s {X) = r(l - a )z a L(l/z)(l + o(l)) I* \- a dp s (A) 

J a J a 

By virtue of Fact |2] and by noting that 

1 sin(7ra) 

r(i-«)r(i + «) ~ na 

the statement of the theorem is obtained. In the a = case, 

rb 

l-<p( flZ )< / (l-<p x (z))dp s (\) < l-<p{bz) 

J a 

where both the lower and upper bounds are ~ 1 — <p{z) since they are slowly 
varying by Fact [3] For the remaining a = 1 case, we again have by [8J p. 280 
that 

' {1-F{s))ds = L{t) 



is a slowly varying function. Then by Fact|3l 

l-f(z)~zl(l/z) z->0 

so 

This finishes the proof again by FactQ] 
To check the last assertion, note that 

U Ao (t,A)(l-F(t)) = U Ao (t,A)r'L(t) ^'^11 

J Q ^-F(s))ds 

Here the first term is finite by what just has been proved while 



[1-F(s))ds = t(l-F(t))+ sdF(s) 

Jo 

□ □ 
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7.5 Proof of the results for O t /Ao (A) 

Proof of Theorem\S\ Since < 00 except for a (0 S negligible set, we again have 
the asymptotic expansion 

<Z>a(z) = 1 - Fa z + °a 0) 
so by noting that again Corollary|3]applies 

W «1J^W 5 V) z ^0 



By (|26l l, this implies 



limj / f O ao (s)rf S = X(A) >0 (31) 

f-S-oo t JO 



which equivalent to what we are seeking by simple arguments. 

In the scaled type case we get the desired formula by = f / A. 

In the scaled type, regularly or slowly varying case, the proof is essentially 
similar to the proof of Theorem[2] □ □ 

7.6 Proof of age and lifetime results 

Proof of Theorem® Through the same procedure as in the proof of Theorem [3] 
in the finite mean case. □ □ 

Proof of Theorem^ Using Theorem |2 we have that if a 6 [0,1), 

By the same arguments as in [8J p.472, we have 
P(txi <Y Ao ,f < tx 2 ) = 

CO 

= E IP(U ye [i- Z2 ,l- % ]{SAo,„ = ty} n {X An+1 > t(l -y)}) 

n=0 

which can be seen to equal 

(l-F(M(l-y)))U Ao (tdy,d\) 



'[1— X2,l— *i] x 
By p2)l , this is asymptotically equal to 
sin(7ra) 1 



— ■ (33) 
™ f h a \-«d Ps {\) 



j 

J\l-xo,X 



(l-F(M(l-y)))U Ao (tdy,d\) 



[l-x 2 ,l- Xl ]x[a,b] l-F(t) !J Ao (i) 
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In the a £ (0, 1) case, the first term in the integral approaches A a {l — y) a , 
while 

- u -iB^^^ m <34) 

as t — »■ oo. The latter can be seen by noting that Fact[T]and Theorem|2]yield 

* / e-JU Ao (tdy,dA) = ^° (Z/ /; A) -> ^±±W) 
UaoCO i[o,»]xA AoV y 7 Uao(0 z " 

as £ — »■ oo, which is the Laplace transform in the time variable of the measure 
in®. 

If a = 0, then the first term goes to one everywhere except y — 1, while the 
Laplace transform above is just 1, which means that the underlying measure 
converges weakly to the point mass at y = 0. 

Because of monotonicity, the approach is uniform and thus we have for 
a G (0,1), that 

sin(Tra) [ l ~ x K A , A -* A -i, 



lim P(txj < Y A „, t < tx 2 ) = — ^ / (1 - y)-"y a - l dy 

If a = and we choose X\ = 0, then we get zero. Since x 2 > is arbitrary, 
the desired result is obtained. 

In the remaining a = 1 case, Theorem [2] implies 

r'U Ao (t) j\l-F(s))ds^ 1 

so instead of l (33|l . we have 

1 r l-F(At(l-y)) U Ao (tdy,dA) 



l h a A-!rfp s (A) ./[l-*2,l-*i]x[ fl ,b] f-i f Q f (l - F(s))ds Uao(0 

Similarly as before, the measure wrt we are integrating can be shown to weakly 
converge to the point mass on y = 1. If y ^ 1, the first fraction in the integrand 
is asymptotically equal to 

1 l-f(f) 



A(l-y) r 1 J t (i-F(s))ds 

which can be shown to approach zero as f -> oo by partial integration. If we 
set x 2 = 1, then since X\ > is arbitrary, the proof is ready. 

The result for the residual lifetime can be obtained through similar modifi- 
cation of the above calculation as in [8 [. □ □ 
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